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BIO  ASSAY;  THE  QUANT  AL  RESPONSE  ASSAY 


H.  C.  Batson 

University  of  Illinois  College  of  Medicine 
Chicago 

I.  INTRODUCTION.  In  many  instances  of  interest  in  medical 
and  biological  research,  the  properties,  activity  or  potency  of  cer- 
tain substances  cannot  be  measured  directly  by  common  in  vitro 
chemical  or  physical  methods,  but  can  be  measured  (quantitated) 
only  in  terms  of  some  effect  they  evoke  in  a living  test  subject,  - 
animal,  plant  or  microorganism. 

Substances  in  this  category  include  many  hormones,  vitamins, 
pharmacologically  and  toxicologically  active  substances,  anti- 
biotics, and  immunologically  active  substances,  - vaccines,  toxins, 
toxoids,  antisera,  allergens,  etc.  Measurement  or  quantitative 
assessment  of  the  activity  of  such  substances  constitutes  the  sub- 
jectmatter  of  biological  assay. 

Design  of  bioassay  experiments  and  statistical  analysis  of  the 
resultant  data  involve  mainly  an  extension  of  principles  and  pro- 
cedures readily  available  in  standard  references  on  experimental 
design  and  statistical  analysis  with  major  emphasis  on  regression 
analysis  and  analysis  of  variance  with  or  without  transformation 
of  the  data  originally  recorded  in  conventional  units. 

II.  TYPES  OF  BIO  ASSAYS 

1.  On  a basis  of  intent:  On  the  basis  of  intent,  bioassays  can 
be  classified  in  one  of  two  main  groups,  - absolute  or  compara- 
tive. 


Absolute  assays;  Absolute  assays  involve  an  attempt  to 

obtain  some  quantitative  measurement  that  can  be  expressed  in 

absolute  terms,  such  as  a Minimal  Lethal  Dose  (MLD)  or  Median 

Effective  Dose  (ED  LD  , etc.).  Such  attempts  are  based 

bO  bCJ 

on  the  assumption  or  belief  that  some  such  absolute  value  exists 
and  that  universally  it  can  be  determined  with  adequate  precision. 
However,  the  absolute  potency  of  substance  X for  "the  cat"  typi- 
cally depends  on  just  which  cat  is  used  and,  unfortunately,  cats 
invariably  do  differ.  Laudable  though  the  goals  and  objectives 
may  be,  absolute  assays  of  biologically  active  substances,  with 
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few  (if  any)  exceptions,  have  little  useful  quantitative  meaning. 


Comparative  assays;  Although  absolute  assays  seldom  if 
ever  yield  adequately  reproducable  results,  it  generally  is  possi- 
ble to  achieve  experimental  quantitation  of  many  biologically 
active  substances  through  assessment  of  the  substance  of  interest 
(unknown)  in  direct  comparison  with  a reference  substance  (stand- 
ard) qualitatively  identical  or,  at  least,  similar  in  terms  of  the 
response  evoked  in  the  test  subject  of  choice.  While  the  absolute 
potency  of  either  may  never  be  known,  the  comparative  or  rela- 
tive activity  of  the  two  may  be  assessed  and  the  biological  activity 
of  the  unknown  expressed  in  relation  to  that  of  the  standard  in 
terms  of  relative  potency,  - whether  expressed  in  proportions, 
percentages  or  in  arbitrarily  defined  units.  By  using  a common 
reference  or  standard  substance,  various  investigators  may  obtain 
quantitative  results  with  a degree  of  comparability  adequate  for 
their  needs.  Such  relative  potency  estimates  are  subject  to  uncer- 
tainty (experimental  error),  of  course,  but  ideally  this  may  be 
kept  within  manageable  proportions.  It  is  this  innate  element  of 
uncertainty  that  makes  bioassay  a candidate  for  statistical  con- 
sideration. 

2.  On  the  basis  of  response:  On  the  basis  of  the  response 
evoked  in  the  test  subjects  of  choice,  most  bioassays  may  be  cate- 
gorized into  one  of  the  following  types: 

Direct  assays;  In  these  the  response  in  the  individual  test 
subject  is  absolute  (live,  die;  response,  non-response;  etc.)  and 
critical  (thresh-hold)  levels  of  the  assayed  material  are  determinate, 
at  least  within  reasonable  limits.  Computations  mainly  involve 
calculation  of  means  and  ratios,  and  estimation  of  standard  errors 
or  confidence  limits  of  such  statistics.  Example:  the  cat  assay 
of  digitalis. 


Graded  response-parallel  line  assays;  In  these,  the 
response  in  the  individual  is  proportional  to  the  dose  of  test  sub- 
stance administered  and  the  degree  of  response  is  experimentally 
determinable.  Typically,  the  degree  of  response  is  a linear  func- 
tion of  log-dose  and  the  dosage -response  regression  lines  of 
“Unknown"  and  "Standard"  will  be  parallel  denoting  identity  or 
similarity  of  action.  Statistical  analysis  involves  mainly  regres- 
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sion  analysis  and  analysis  of  variance.  With  proper  design 
(balanced  or  partially  balanced  factorial  assays),  analysis  can  be 
simplified  greatly  through  the  use  of  coefficients.  Example; 
assay  of  insulin  in  the  rabbit. 

Slope -ratio  assays;  These  include  mainly  the  microbiolo- 
gical assays,  a group  of  rather  limited  general  interest  in  which 
the  degree  of  measurable  response  in  the  individual  probably  is 
absolute,  but  since  masses  of  test  subjects  (microorganisms)  are 
dealt  with,  the  total  response  measured,  as  density,  acid  forma- 
tion, etc.  , approaches  a continuous  function.  Statistical  analysis 
involves  multiple  regression  and  relative  potency  is  estimated 
from  the  ratio  of  the  partial  regression  coefficients.  Example; 
microbiological  assay  of  riboflavin. 

Quantal  response  assays;  In  these,  response  in  the  indi- 
vidual test  subject  is  absolute  (frequently,  live  or  die)  but  the 
critical  dose  of  test  material  necessary  to  evoke  the  response  is 
not  directly  determinable.  Quantitation  is  achieved  through  the 
use  of  groups  of  test  subjects  and  determination  of  the  proportion 
responding  to  various  dosage  levels  of  "Unknown"  and  "Standard" 
test  products.  Following  suitable  transformation  of  the  data 
(probits,  angles,  etc.  , ) response  typically  is  a linear  function  of 
log  dose  and  statistical  analysis  is  essentially  similar  to  that 
employed  with  the  graded  response -parallel  line  bioassays.  Ex- 
amples: mouse -protective  potency  assays  of  typhoid,  pertussis  and 
rabies  vaccines. 

III.  REQUIREMENTS  OF  A VALID  BIOASSAY.  The  follow- 
ing requirements  of  a "valid"  bioassay  have  evolved  from  recom- 
mendations originally  made  by  Gaddum  (1)  with  modifications  made 
by  Bliss,  Finney,  and  others,  and  are  practically  universally 
accepted  by  students  of  bioassay.  Perhaps  the  word  "valid"  should 
be  replaced  by  "good"  or  "acceptable.  " 

1,  The  assay  should  involve  a direct  comparison  of  an  un- 
known with  a standard  in  identical,  concomitant  tests. 

a.  Ideally,  the  two  products  should  be  of  essentially 
equal  potency. 
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2.  There  should  be  a significant  progressive  relationship 
between  dosage  and  response. 

a.  Linear  following  transformation  as  required. 

b.  Highly  significant  slope. 

c.  No  significant  curvature;  combined  or  opposed. 

3.  Dosage-response  regression  lines  for  the  two  products 
should  be  parallel,  denoting  identity  or  similarity  of  action. 

4.  There  should  be  internal  evidence  of  homogeneity  (of  the 
data)  establishing  validity  of  statistical  analysis  and  adequacy  of 
the  testing  situation. 

5.  Analysis  should  include  an  estimate  of  assay  error  (uncer- 
tainty) calculated  directly  from  the  data. 

Obviously,  not  all  requirements  can  be  applied  to  each  type 
of  assay.  Requirements  pertaining  to  slope  do  not  apply  to  direct 
assays;  those  pertaining  to  parallelism  do  not  apply  to  slope-ratio 
assays,  etc.  However,  all  do  apply  to  parallel-line  graded  response 
assays  and  most  quantal  response  assays  are  of  similar  design. 

IV.  REDUCTION  OF  UNCERTAINTY  (ERROR)  OF  BIOASSAYS  . 

All  experienced  bioassayists  are  aware  of  the  innate  uncer- 
tainty and  poor  reproducibility  of  such  assays  as  a vhole.  The 
degree  of  variability  differs  markedly  with  various  assays,  perhaps 
being  least  with  slope -ratio  assays  eind  greatest  with  quantal 
response  assays.  This  variability  can  be  reduced  to  some  extent 
in  a variety  of  ways  including: 

1.  Perfection  of  technique:  equipment,  reagents,  etc. 

2.  Control  of  environment:  constant  temperature,  humidity. 


3.  Increased  homogeneity  of  test  subjects:  selection  of  strains, 
sex  and  size  of  test  animals;  use  of  litter  mates,  etc. 
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4.  Use  of  restricted  designs;  randomized  blocks  (complete 
or  incomplete),  Latin  squares,  cross-over  designs,  confounding, 
etc. 


4 
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5.  Statistical  adjustment  of  data;  covariance  analysis,  adjust- 
ing response  data  on  the  basis  of  a pertinent  associated  measure- 
ment . 

6.  Increasing  the  number  of  observations  (test  subjects), 
either  by  using  more  subjects  per  assay  or,  preferably,  by  inde- 
pendent replication  of  the  assay  as  a whole. 

In  many  quantal  response  assays,  particularly  assays  of 
vaccines,  antisera,  etc.  , most  of  the  above  conventional  approaches 
accomplish  only  modest  reduction  in  assay  error.  Slopes  of  the 
dosage-response  regression  lines  characteristically  are  low, 
constituting  a major  source  of  assay  error,  and  the  main  direct 
compensating  approach  is  to  increase  the  number  of  test  subjects,* 
A major  reduction  in  assay  error,  however,  would  require 
impractically  large  numbers  of  subjects.  Practical  solution  to 
many  of  these  problems  probably  lies  in  the  development  of  assay 
procedures  involving  new  experimental  approaches.  If  some 
meaningful  response  or  attribute  of  the  individual  test  subject  can 
be  measured  as  a continuous  variable,  a graded  response -parallel 
line  assay  procedure  should  be  possible.  Typically,  errors  of 
these  assays  are  much  less  than  c£  quantal  response  assays.  In 
some  situations,  "time  to  death"  has  shown  promise  as  a mean- 
ingful quantitative  response  metameter. 

V.  REQUIREMENTS  OF  AN  ADEQUATE  STATISTICAL 
ANALYSIS. 

1.  The  analysis  should  provide  for  the  acceptance  or  rejec- 
tion of  the  assay  results  as  a whole;  - such  acceptability  based 

In  simplified  probit  analysis,  a crude  approximation  of  the  stand- 
ard error  of  M (log- ratio  of  potency)  is  given  by 

- -L  ./!_+  i_ 

"m"  b^  VNu  Ng 

where  b = combined  (average)  slope,  and  N.  and  N_.  = the  number 
of  test  subjects  assigned  to  the  unknown  and  standard,  respectively 
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upon  the  requirements  outlined  in  part  III. 

2.  The  analysis  should  provide  for  a reliable,  unbiased  esti- 
mate of  relative  potency  that  is  independent  of  dosage  throughout 
the  maximum  possible  range. 

3.  The  analysis  should  provide  for  an  estimate  of  assay  uncer  - 
tainty,  - preferably  expressed  as  confidence  limits  of  the  relative 
potency,  - provided  meaningful  alternatives  for  action  based  upon 
such  resultant  estimates  can  be  established. 

Of  the  above  requirements,  the  first  is  considered  by  this  writer 
to  be  the  most  essential  and  the  one  most  commonly  unrecognized  or 
neglected  in  routine  analysis  of  bioassay  data.  Specific  computational 
procedures  and  illustrative  examples  for  all  the  main  types  of  bio- 
assays  are  given  in  standard  reference  books  such  as  Burn  (2),  Bliss 
(^),  and  Finney  (4,  ^). 

VI.  STATISTICAL  ANALYSIS  OF  QUANT AL  RESPONSE 
BIO  ASSAY  DATA.  A surprising  number  and  variety  of  computational 
procedures  for  analysis  of  quantal  response  bioassay  data  have  been 
proposed.  In  terms  of  statistical  rigor  and  sophistication,  they 
range  from  simple  "quick-and-dirty"  graphic  approximations  to  for- 
mal iterative  procedures  involving  a degree  of  complexity  and  tedi- 
ous computational  detail  which  is  difficult  to  justify  except,  possibly, 
in  the  most  critically  extenuating  circumstance. 

Most,  or  perhaps  all,  of  these  methods  have  some  advantages 
or  disadvantages  dependent  upon  their  contemplated  use  but  any 
critical  comparison  is  far  beyond  the  scope  of  this  presentation.  It 
is  consoling  to  find,  however,  that  they  all  lead  to  closely  similar 
estimates  of  relative  potency  (or  end-points)  when  applied  to  truly 
good  data  as  defined  in  Part  III.  Unfortunately,  the  simpler  approx- 
imate methods  generally  do  not  provide  a basis  for  discrimination 
between  acceptable  and  non-acceptable  data  and  when  applied  unwit- 
tingly to  truly  unreliable  data  may  yield  estimates  which  are  seri- 
ously misleading. 

The  more  commonly  used  computational  procedures  can  be  class! 
fied  into  four  general  categories.  These  general  categories,  example 
of  methods  included  in  each,  and  minimal  comments  regarding  each, 
are  given  below; 
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Class 

Examples 

Comments 

Graphic 

approximations 

Miller  -Tainter 
(6). 

Minimal  calculations;  ade- 
quate reliability  provided  good 
data;  some  discriminatory 
power  by  inspection. 

Calculated 
app  r oximation  s 

Reed-Muench 
Behrens  (7). 

Most  widely  used  and  proba- 
bly least  reliable  of  all  methods; 
limited  to  estimating  50  /o 
endpoint. 

Formal 

procedures 

Probit  analysis; 
Bliss  (8),  Finney 
(5). 

Knudsen-Curtis  (9). 

Laborious  calculations;  max- 
imum reliability  and  discrimi-  uL 
inatory  power. 

Compromise 

methods 

Litchfield- Wilcoxon 
(12)’ 

Generally  adequate  relia- 
bility and  discriminatory  power; 
appreciably  less  calculations 
than  formal  methods. 

Another  method,  involving  a factorialTf  approximation,  is  proposed 
by  this  writer.  This  should  be  considered  a compromise  method  and  is 
presented  in  some  detail  in  part  VII  of  this  presentation. 


The  factorial/  approximation  is  based  essentially  on  analysis  of 
variance  of  quantal  response  data  espressed  in  terms  of  per  cent  response 
and  log  dose.  When  used  with  data  from  balanced  factorial  bioassays 
involving  a constant  number  of  test  subjects  per  experimental  unit,  ade- 
quate tests  for  acceptability  of  the  data,  the  relative  potency  estimate  and 
an  approximation  to  confidence  limits  of  the  relative  potency  estimate  can 
be  obtained  with  only  moderately  extensive  calculations.  Analysis  of  the 
data  from  numerous  factorial  quantal  response  bioassays  by  this  method 
has  yielded  results  in  close  agreement  with  those  obtained  by  formal  probit 
analysis  (5)  and  the  Knudsen-Curtis  method  (9). 

Vn.  FACTORIAL/^  ANALYSIS  OF  QUANTAL  RESPONSE  BIOASSAY 
DATA . In  a previous  report  (U)the  essential  computational  details  of 
factorial  analysis  of  attribute  (enumeration)  data,  as  developed  by 
Brandt,  were  presented  together  with  illustrations  of  applications  of  the 
method  to  selected  experiments  in  industrial  chemistry.  Two  forms  of 
the  basic  formula  were  presented.  The  first  "(Formula  1)"  being  the  form  for 
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calculating  values  of  X for  individual  degrees  of  freedom  from  complete 
factorial  experiments  in  which  the  experimental  units  are  of  equal  size, 
was  given  as 

^2  = Ji  X I- 

[l]  SxF  D 

where  N = total  individuals  or  observations;  S = total  successes; 

F = total  failures;  T = the  total  of  the  sums  of  products  of  factorial 
coefficients  and  the  number  of  successes  in  the  corresponding  experi- 
mental units;  D = the  product  of  the  sums  of  the  squares  of  the  fac- 
torial coefficients  and  the  number  of  individuals  per  experimental 
unit;  and,  the  subscript  in  brackets  indicates  the  degrees  of  free- 
dom. Either  of  the  outcomes  (yes  or  no,  response  or  non-response, 
survival  or  death,  etc.)  can  be  designated  as  success;  the  other 
outcome  as  failure. 

In  many  instances,  quantal  response  bioassay  data  can  be  sub- 
jected to  factorial X 2 analysis;,  the  major  restrictions  being  that 
the  experimental  units  are  of  equal  size  and  that  successive  doses 
of  the  independent  variable  (i.  e.  , the  toxic  or  protective  substance 
being  assayed)  differ  by  a constant  interval  when  expressed  in 
appropriate  units  of  measurement.  In  most  (perhaps  all)  assays  of 
immunologically  active  substances,  the  successive  doses  (levels  of  X) 
should  be  increased  or  decreased  in  a geometric  series  such  as 
1,  2,  4,  8,  16;  1,  3,  9,  27;,  etc.,  as  the  differences  between  the 
logarithms  of  successive  doses  are  constant  in  value.  When  these 
restrictions  are  complied  with,  factorial  coefficients  (3)  can  be 
used  directly  in  analysis  of  the  data  and  7^  values  can  be  computed 
by  the  formiila  given  above.  In  this  manner  it  is  possible  to  obtain 
statistical  information  regarding  the  validity  or  adequacy  of  the 
data  (Part  III)  and,  as  shown  below,  to  obtain  a direct  estimate  of 
relative  potency  and  its  approximate  confidence  limits. 

The  procedures  are  illustrated  with  actual  examples  of  both 
2-dose  (4-point)  and  3-dose  (6-point)  assays  of  the  mouse  protec- 
tive potency  of  typhoid  vaccine  performed  by  the  author  at  the  Army 
Medical  Service  Graduate  School.*  Details  of  the  assay  procedure 
employed  have  been  published  previously  (12);  attention  here  will 
be  limited  primarily  to  statistical  treatment  of  the  data. 


* 

Now  known  as  Walter  Reed  Army  Institute  of  Research, 
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1.  FactorialX^  analysis  of  a 2-dose  quantal  response  bioassay 
As  a part  of  a study  to  determine  the  reproducability  of  mouse 
protection  potency  assays  of  typhoid  vaccine  (13),  a series  of  6 
assays  were  run  on  identical  aliquots  of  a reference  vaccine.  The 
aliquotes  were  identified  only  as  A and  B and  prior  to  the  assay  it 
was  decided  to  calculate  their  relative  potency,  B as  per  cent  of  A. 
Data  from  the  sixth  trial  are  reproduced  in  Table  I. 

Table  I 

Two-dose  assay  of  the  mouse  protective  potency  of 


typhoid  vaccines 
(Survivals/totals) 


Vaccine 

Vaccine 

dose  (ml) 

0.015 

0.15 

A 

5/20 

13/20 

B 

2/20 

15/20 

For  factorial  analysis,  these  data  are  rearranged  to  the 
form  given  in  Table  lA.  For  purposes  of  obtaining  tests  of  signi- 
ficance {%?)  it  is  of  no  consequence  in  which  order  the  vaccines 
are  entered  in  the  table  or  which  comparison  groups  are  assigned  + 
and  - coefficients.  However,  in  the  estimation  of  relative  potency, 
slope,  etc.  , computations  are  more  convenient  if  certain  orders 
are  followed.  For  the  comparison  between  products  (designated  as 
comparison  a),  positive  coefficients  should  be  assigned  to  the 
"unknown"  (vaccine  B in  this  case).  Likewise,  for  the  estimation 
of  slope  (comparison  a),  positive  coefficients  shovild  be  assigned  to 
the  higher  dose  level.  Assignment  of  coefficients  to  the  interaction 
comparison  (ab)  is  uniquely  determined  as  the  cross  products  of 
coefficients  for  the  first  2 comparisons,  of  course.  This  assign- 
ment of  coefficients  is  consistent  with  that  employed  by  Bliss  (3) 
and  others. 
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Table  lA 

Factorial  analysis  of  the  data  on  Table  I 


Vaccine 


B A 

(unknown)  (standard) 


Low  High  I Low  High 


■1  1 80  0.012  9 0.05 


441  80  5.  5125  22.  38 


5 25  80  O.  3125  1.  27 


Success  ( survivors) 


20 


Comparisons 

a Unknown  vs  standard 


b Slope  (high  vs  low  dose 


ab  Departure  from  paral- 
lelism (products  X doses) 


*2  80^ 

Evidence  of  assay  validity;  All  calculations  are  performed  in 
the  manner  previously  described  (U).  From  comparison, a,  it  is  found 
that  the  2 vaccines  do  not  differ  appreciably  in  total  effect  (X^W  =0.05). 
From  comparison  b it  can  be  seen  that  there  is  a highly  significant 
relationship  between  dosage  and  response  (X^  [l]  = 22.  38),  and  by 
comparison  ab  it  is  determined  that  there  is  no  significant  departure 
from  parallelism  exhibited  by  the  dosage  response  lines  for  the 
unknown  and  standard.  No  information  is  available  concerning  curv- 
ature of  the  dosage  response  curves.  Such  can  be  obtained  only 
when  3 or  more  dosage  levels  are  employed. 

As  the  assay  actually  was  conducted,  the  20  mice  in  each  experi- 
mental unit  were  not  handled  as  a single  group  but  as  4 independent 
groups  of  5 each.  These  groups  were  selected,  assigned  spaces  in  the 
test  room,  immunized  and  challenged  in  random  order  and  the  number 
of  survivors  originally  were  recorded  per  group  of  5.  Thus  it  is 
possible  to  calculate  a "within  groups"  ^ with  12  degrees  of  freedom 
which  can  be  used  as  a measure  of  internal  homogeneity  (require- 
ment 4).  The  procedure  will  be  illustrated  with  data  from  the  next 
example  (Table  II). 

Estimation  of  relative  potency:  It  is  possible  to  obtain  an  esti- 
mate of  relative  potency  (RP)  from  the  data  and  calculations  of 
Table  lA  by  use  of  the  formula  for  estimating  relative  potency  from 
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a 2-dose  factorial  assay  as  given  by  Bliss  (3), 


- i X T 


where  M = the  log  ratio  of  potency;  i = the  log-dose  increment*; 
and,  Tg^  and  are  the  values  in  the  column  headed  T for  compar- 
isons a and  b,  respectively.  In  this  assay,  the  dosage  increment 
was  lO-fold,  so  i = log  lO  = 1.  Tg^  = -1  and  = 21.  Substituting 
these  values  in  the  formula,  M is  calculated  as 


1 X -1 


= -0.0476. 


This  value  is  a logarithm  and  must  be  converted  to  the  usual  form 
1.  9524.  The  antilogarithm  of  1.  9524  is  the  relative  potency  which 
is  found  to  be  O.  896;  or,  in  terms  of  percentage,  vaccine  B is 
89.  6 per  cent  as  potent  as  vaccine  A.  This  estimate  is  in  reason- 
ably close  agreement  with  that  obtained  by  probit  analysis,  85.4 
per  cent. 


Approximate  confidence  limits  of  relative  potency : It  also  is 
possible  to  obtain  an  approximation  of  the  confidence  limits  of  the 
relative  potency  estimate  from  the  data  and  calculations  presented 
in  Table  lA.  This  is  most  easily  done  by  first  determining  the 
approximate  confidence  interval  for  M(CI'j^)  which  for  a 2-dose 
assay  is  calculated  as 

, _ 1.96x2  n/^fN  X i ** 


where  n = individuals  per  experimental  unit;  N = 4n  or  grand  total 
individuals,  and  i and  T^  have  the  same  meaning  as  before.  The 


*LiOgarithms  of  dosage  increments  from  2-fold  to  lO-fold  are  tabulated 
in  Table  1,  Appendixl  and  designated  as  constants  cj^  2 

**The  term  "confidence  interval"  typically  is  usedto  denote  the  entire 
range  included  between  lower  and  upper  confidence  limits.  The  quantity 
approximated  by  Cl' j^,  as  usedhere,  is  one -half  the  entire  range  ex- 
pressed in  logarithmic  units.  Derivationof  this  approximation  is 
given  in  App  endix  II  to  thi  s pape  r . 
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95  per  cent  confidence  limits  of  M then  are  determined  as 


M + Cl" 

"■  M 

and  the  95  per  cent  confidence  limits  of  the  relative  potency 
(95%  CL  ) are  found  as  the  antilogarithms  of  these  2 values. 

xvJc^ 

95%  CLj^p  = antilogarithms  of  M-CI^  and  M+CI^. 

These  limits  will  be  in  the  form  of  ratios  which  can  be  converted 
to  percentage  by  multiplying  by  100.  For  the  illustrative  problem 
dealt  with  here  (Tables  I and  lA) 


/ _ 1 . 96  X 40/t/80  X log  1 0 _ 


= 0.4174 


Then 


95%  CL^,  = -0.  0476  + 0.4174  = -0.4650  and  0.  3698 
M 


= 1. 5350  and  0.  3698 


Taking  antilogarithms 

95%  CL__  = 0.  34  and  2.  34 
or  34%  and  234%. 

Thus,  the  best  estimate  of  relative  potency  (Bas  per  cent  of  A)  is 
89-  6 per  cent  and  the  odds  are  approximately  19  out  of  20  that  the 
true  potency  is  between  34  and  234  per  cent. 


For  a factorial  assay  of  set  design,  where  i and  n are  constant, 

assay  to  assay,  the  foregoing  calculations  can  be  simplified  as  all 

elements  in  the  formula  for  CI^  will  be  the  same 

M 
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except  for  T . Thus  constants  for  2-dose  assays  (C_  ) and  3- 

b 1.2 

dose  assays  (C^  fold-increments  of  dosage  from  2 to  lO, 

and  for  values  of  n from  lO  to  20,  have  been  calculated  and  are 
presented  in  Appendix  1,  Tables  2 and  3. 

It  must  be  emphasized  that  this  estimate  of  the  confidence 
limits  of  the  relative  potency  is  only  an  approximation.  Yet  the 
results  obtained  were  in  reasonably  close  agreement  with  those 
obtained  by  probit  analysis,  31.  6 and  230.4  per  cent. 

2 . 

2.  Factorial  X analysis  of  a 3 -dose  quantal  response  bioassay. 

2 

Factorial  X analysis  of  a 3-dose  quantal  response  assay  for  deter- 
mining the  validity  of  the  assay  and  the  estimation  of  relative  potency 
and  approximate  95/o  confidence  limits  of  the  potency  estimate,  are 
illustrated  with  data  from  another  typhoid  vaccine  mouse  protection 
potency  test  performed  at  the  Army  Medical  Service  Graduate 
School.  The  vaccines  tested  were  a routine  production  lot  (unknown) 
and  a reference  standard.  Results  of  the  assay  are  summarized  in 
Table  II,  and  are  arranged  in  the  form  suitable  for  factorial  X 
analysis  in  Table  IIA. 


Table  11 

Three -dose  assay  of  the  mouse  protective  potency 
of  an  unknown  typhoid  vaccine  in  respect  to  a standard 


(Survivors/totals) 


Vaccine 

Vaccine  dose  (ml) 

0.02 

0.08 

O.  32 

Unknown 

1/10 

5/10 

8/10 

l/io 

7/10 

9/10 

Standard 

2/10 

4/10 

8/10 

l/lO 

5/10 

7/10 
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Table  IIA 

Factorial  analysis  of  the  data  of  Table  II 


Vaccine 


Dose 


uccess 


lO 


Successes/  20 


Unknown  I Standard 


D2I  D3I  Di  D2 


12  17 


mm 


E+  S- 


a Unknown  vs  standard 

b Slope 

ab  Parallelism 

c Combined  curvature 


31  27 


16  120  0.13 


27  729  80  9.11 


3 9 80  0.11 


5 25  240  0.10 


5 25  240  0.10 


* 2 T^ 

^ sTf  * 'B 


_J^xX=4.GO; 

58  X 62  D 


Between  groups  within  experimental  units; 


4.00  X 


= 4:OOx- 


= 1.  60. 


There  is  little  need  for  comment  regarding  the  computational 
procedure  employed.  Factorial  coefficients  were  assigned  in  con- 
ventional order  and  7^^  values  for  each  comparison  were  com- 
puted in  the  manner  previously  described.  Calcvilation  of 
"between  groups  within  experimental  units"  was  accomplished  by 
summation  of  all  T^/D  values  between  pairs  of  groups  of  lO  each 
and  multiplying  the  total  by  the  constant 

S X F 

Evidence  of  validity 

There  was  no  evidence  of  significant  differences  between  the 
pairs  of  groups  within  experimental  units  !•  60)*  This 

yields  assurance  that  the  randomization  procedures  employed  dur- 
ing the  assay  were  adequate  to  prevent  appreciable  bias  due  to  tech- 
nical and  environmental  factors.  Since  3 dosage  levels  of  vaccine 
were  employed,  it  was  possible  to  gain  information  regarding  curva- 
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ture  of  the  dosage  response  lines,  both  combined  and  in  opposition. 
There  was  no  evidence  of  systematic  departure  from  linearity. 
Thus,  all  requirements  for  assay  validity  (Part  III)  were  satisfied. 

Estimation  of  relative  potency 


The  relative  potency  of  the  unknown  in  respect  to  the  standard 
was  estimated  by  the  formula  given  by  Bliss  (3)  for  calculating  M 
in  3-dose  factorial  assays 


M = 


4 X i X Tj 
3 X Tb 


The  dosage  increment  employed  in  this  assay  was  4 -fold,  so 
i=  log  4 = 0.  6021.  Substituting  calculated  values  of  T and  T^^ 
into  the  formula,  M was  calculated  as 


M = 


4x0.  6021  X 4 
3 X 27 


= o:ii89 


and  the  relative  potency  = lOO  x antilog  0.1189  = 131.  5 per  cent. 
Approximate  confidence  limits  of  relative  potency 

The  formula  for  estimating  the  approximate  confidence  inter- 
val of  M in  a 3-dose  assay  differs  from  that  for  2-dose  assay  only 
in  that  4n  must  be  substituted  for  2n.  Thus,  for  a 3-dose  factor- 
ial assay. 

ClJ^  = 1,  96  X 4n/*/lk  X i 
T, 


* Vainpfi  nf  ^ ^T'drisagp  increments  of  2-fold  through  lO-fold  have 
been  calc\ilated  and  are  given  as  constants  Cj^  in  Table  1,  Appen- 
dix I.  M is  determined  by  multiplying  the  ratio  ^T  by  the  appro- 
priate value  of  Cj^  ^ (O.  8020  in  this  example). 
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For  the  data  dealt  withhere.J^Tables  II  and  IIA),  n = 20,  N = 120, 
and  i = log  4 = 0.  6021.  Then 

/ _ 1.  96  X 80Ari20  X O.  6021 » 

27 

= O.  3192. 


The  confidence  limits  of  M are  found  as 


95  % CL.,  = M ± Ci;, 


= 0. 1189  + O.  31  92  = -O.  2003  and  O.  4381 
= T,  7997  and  0.4381 

Then  the  95  per  cent  confidence  limits  of  the  relative  potency  are 
obtained  as  the  antilogarithms  of  these  values. 

95%  = O.  63  and  2.  74 

or  = 63  and  274  per  cent 

These  data  also  were  analyzed  by  the  probit  analysis.  The 
relative  potency  estimate  was  132.  2 per  cent  and  the  95  per  cent 
confidence  limits  were  64.  2 per  cent  and  272.  2 per  cent. 

3.  Resum^  of  computational  procedure:  Chi  square  analysis 
of  quantal  response  factorial  assays  yielding  (l)  statistical  evidence 
regarding  reliability  of  the  data,  (2)  an  estimate  of  relative  potency, 
and  (3)  approximate  confidence  limits  of  the  relative  potency, 
involves  a series  of  7 main  steps. 

1.  Arrange  the  data  on  a work  sheet  of  the  form  used  in 
Tables  I A and  IIA. 


2.  Assign  the  factorial  coefficients  in  accordance  with  the 
actual  design  of  the  experiment.  Compute  N^/SxF  from  the  grand 

^Constants  c^  ^ for  estimating  values  of  in  3-dose  factorial 

assays  for  dosage  increments  of  2-fold  through  lO-  fold  and  for 
values  of  n from  lO  through  20,  have  been  calculated  and  are  given 
in  Table  3 of  the  appendix.  For  this  problem,  c.^  -i  ~ ^183.  This 

divided  by  27  (T  ) = O.  3192,  the  same  as  calculated  above. 


Design  of  Experiments 


567 


2 2 2 

totals  and  then  S +,  S T,  T , D,  T /D  and  "X  for  each  compari- 
son (row).  Also,  if  data  on  subgroups  within  experimental  units  are 
available,  calculate  the  "between  groups"  (cf.  Table  IIA).From 
the  various  values  of  7(^  determine  if  there  is  sufficient  evidence 
of  validity  to  justify  estimation  of  potency. 

3.  If  justified,  compute  the  ratio  calculate  M as: 

a.  Two  dose  assay:  M = i x T /T  . Values  of  i are 

a b 


given  as  the  constants  c^^  Table  1,  Appendix  I. 

Values  of 


4x1 

b.  Three-dose  assay:  M = — x 


a b 


4 X i are  given  as  the  constants  c^^  ^ in  Table  1, 
3 

Appendix  I. 


4.  Determine  the  relative  potency  (RP)  as  a ratio  or  per- 
centage as  antilog  M,  or  as  100  x antilog  M,  respectively. 

5.  Compute  as: 

a.  Two-dose  assay: 

_ 1 . 96  X 2n>/K  x i 


Cl 


M 


or,  using  constants  c from  Table  Z,  Appendix  I: 

JL  • b 


Cl 


'I.  2 


M 


b.  Three-dose  assay: 

./  _ 1 . 96  X 4n/>/N  x i 


Cl 


M 


or,  using  constants  c^  ^ I^om  Table  3,  Appendix  I: 


cr 


'1.  3 


M 


6.  Calculate  the  95  per  cent  conficence  limits  of  M as 
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Table  1 

Values  of  ^ 2 obtaining  estimates  of  M, 

the  log  ratio  of  po'tency,  from  2-dose  and  3-dose  factorial  assays 

(M  = c.  - . X T /T,  . * 

M.  1 a b) 


Fold-increment 
in  dosage 


M.  2 

(2-dose  assays) 


M.  3 

(3-dose  assays) 


O.  3010 


0.4013 


0.4771 


O.  6361 


O.  6021 


O.  8028 


O.  6990 


O.  9320 


O.  7782 


1.0376 


O.  8451 


1.1268 


O.  9031 


1.  2041 


O.  9542 


1.  2722 


lO 


1.0000 


1.  3333 


$ 


^Relative  potency  = antilog  M. 

o. 

Relative  potency  in  /o  = lOO  x antilog  M. 
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APPENDIX  II 


Approxinration  of  the  Confidence  Interval  of  M 


The  standard  error  of  M (s^,)  from  a balanced  factorial 
bioassay  is  given  by  Bliss  (3)  as: 


M 


s 

b 


N 


1 + 


D' 


r* 


where  D^  = mean  square  between  products;  = mean  square  for 
combined  slope;  s^  = mean  square;  t = Student's  statistic;  N = 
total  number  of  test  subjects  (possible  responses);  and  b is  the 
combined  or  average  slope  of  the  dose-response  regression  line. 


For  a 2-dose  (4-point)  assay, 
for  a 3-dose  (6-point)  assay,  as 


be  is  estimated  as 
Tb  . In  these. 


Tb 

2 X i X n 


4 X i X n 

Tb  is  found  as  shown  in  Tables  lA  and  IIA,  i is  the  log  ratio  of  dosage 
increment,  and  n is  the  number  of  test  subjects  per  experimental 
group. 


In  a good  bioassay  (statistically  acceptable),  D will  be  small 
and  B^  will  be  large.  Thus,  the  quantity  enclosed  in  brackets 
approaches  unity  and  can  be  ignored.  In  the  binomial,  the  variance 
(s^)  has  a maximum  value  of  O.  25  and  s has  a maximum  value 
of  O.  5.  In  a balanced  assay  of  fixed  design,  N will  be  4n  or  6n  for 
a 2-dose  and  3-dose  assay,  respectively.  Substituting  the  appro- 
priate formula  for  b as  given  above,  and  introducing  too  = 1.  96, 
the  confidence  intervals  of  M can  be  reduced  to  the  following 
approximations: 


, CI„  (1.96  X 2n  X i)/  fr7 

2- dose  assay:  M = = 

^b 

Cl  (1.  96  X 4n  X i)/  /n~ 

3- dose  assay:  M = ;= ^ 

■^b 


These  approximations  were  used  for  calculating  the  constants 
presented  in  Tables  2 and  3 of  Appendix  I. 
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